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We study the Hamiltonian associated with the quantum adiabatic algorithm with a random 
cost function. Because the cost function lacks structure we can prove results about the ground 
state. We find the ground state energy as the number of bits goes to infinity show that the 
minimum gap goes to zero exponentially quickly, and we see a localization transition. We 
prove that there are no levels approaching the ground state near the end of the evolution. 
We do not know which features of this model are shared by a quantum adiabatic algorithm 



in 



o 
d 

o 

> 



applied to random instances of satisfiability since despite being random they do have bit 



o 

structure. 

I. INTRODUCTION, DISCUSSION, AND CONCLUSIONS 

s 

Recently there has been interest in the relevance of Anderson localization to the quantum adia- 
batic algorithm [TJ [2j [5]. In this paper we study properties of the Hamiltonian associated with the 
adiabatic algorithm with a cost function that has random (essentially) uncorrelated values. The 

> 

cost function we look at does not have the structure present in cost functions produced by random 

o 

instances of satisfiability. This lack of structure makes our example analyzable and the localization 



transition and corresponding small gap will be evident. The model is a spin Hamiltonian on n spins 
that takes the form 

n , i v 2"-l 

H(s) = (1 - s) 53 ( + * E E (*)\*)(*\- (!) 

i=l ^ ' z=0 

The "on site energies" E(z) are random variables obtained by scrambling the Hamming weight cost 

a 

function. Viewing z in |I| as an n bit string, the Hamming weight W(z) is the number of ones in 
the string. Let 7r be a random permutation of the 2 n integers between and 2 n — 1. By "random 
permutation" we mean that all 2 n \ permutations are equally likely. Note we are permuting the 2 n 
strings, not the n bits. Then 

E{z) = W{k-\z)) (2) 



and 



n , i s 2 n -l 

H n (s) = (1 - a) J2[ )+ s H W(n-\z))\z)(z\. (3) 

1=1 ^ ' 2 = 



2 



In figure[T]we plot the lowest 25 energy levels of this Hamiltonian, as a function of s, with n = 18 
and with a particular random choice of the permutation tt. Different random permutations produce 
very similar pictures. The ground state energy is well approximated by two straight lines [5| [71 IIP]. 
We will prove that asymptotically (in n) they are in fact straight lines. At s = | the gap between 
the ground state and the first excited state is small and we will show that asymptotically the 
minimum gap is exponentially small in n. 

This Hamiltonian is similar to the "random energy model" of the form ([I]) with on site energies 
chosen i.i.d, that is, independently and identically distributed. Some of what we prove is already 
known for the random energy modeljTJ [TU1 |TTj. For example, in [7J, Jorg et. al. use perturbation 
theory to show the existence of a first order phase transition in a random energy model. In contrast, 
we use variational methods which prove upper and lower bounds on the ground state energy. To 
prove that the gap is exponentially small in n, we use the information theoretic result [5] that no 
efficient quantum algorithm exists for locating the minimum of a scrambled cost function. 

It is apparent from the picture that the ground state changes dramatically at s = g. In fact for 
s < J, the ground state is very close to the ground state at s = P, 

j 2 n -l 

\x = 0) = -= V \z) 

VZ z=0 

which in the z basis is completely delocalized. For s > J the ground state is close to the ground 
state at s = 1 which is 

\ Z = 7T(0)) 

corresponding to one z string, that is, a fully localized state. 

The small gap just seen at s = ^ is associated with a "delocalized to localized" first order phase 
transition. Recently it has been suggested that a "localized to localized" ground state transition 
can also lead to an exponentially small gap. These ground state transitions, studied in [IHUE], can 
be seen using low order perturbation theory, and occur for s — > 1 as n — > oo. There are two key 
features of a model that exhibits these perturbative crosses. First, for any string a single bit flip 
changes the cost function by O(l). The other feature is that there are very disparate bit strings 
with low cost. The scrambled model that we study has the second feature but not the first and we 
show that perturbative crosses are not present. We prove that for s > 0.9 the gap is greater than 
a positive constant independent of n. 
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Figure 2: Lowest 25 levels for the instance with the identity permutation at n = 18. 
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Figure 3: Energy levels in the middle of the spectrum for a 14 spin instance with a random permutation. 



The regularity in figure [T] and the simple description of the ground state are consequences of the 
total lack of structure in the scrambled cost function. Although it is not relevant to the performance 
of the adiabatic algorithm, it is interesting to look at the middle of the spectrum. In figure [3] we 
show energy levels in the middle of the spectrum for a random choice of tt at n = 14. Here there 
are many avoided crosses and no apparent regularity in contrast to the bottom of the spectrum. 

Suppose the permutation tt used to generate figure [T] were replaced by the identity. Now the cost 
function, E(z) = W(z), is the unscrambled Hamming weight and the Hamiltonian (|3j) is a sum of 
n one qubit Hamiltonians making it easy to analyze. The lowest 25 levels for n = 18 are shown in 
figure [2] Note that the minimum gap is independent of n. Furthermore the values and degeneracies 
of the on site energies in figure [2] are the same as those in figure [TJ The radical differences between 
these figures are caused by the bit structure present in the unscrambled case but absent in the 
scrambled case. 

It is not yet known how the quantum adiabatic algorithm performs on random instances of 
satisfiability, for example, instances of Exact Cover generated by random choices of 3 bits |12[ 113] , 
Despite the randomness, these Hamiltonians still have bit structure. We do not know if random 
instances of satisfiability have a "delocalized to localized" first order phase transition like the fully 
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unstructured example shown in figure [T] or have no "delocalized to localized" phase transition like 
the bit structured example shown in figure [2] 



II. RESULTS 



For a given n and tt we have H n (s) given by (|3]). Denote the ground state energy by E^{s). 
Also let 



e(s) = < 



f for < s < \ 

^ for i < s < 1. 



(4) 



We have 3 results which suffice for our needs but are not best possible. First E ^ s ^ is well 
approximated by e(s) for n large. 



Theorem 1. Let tt be a random permutation. Then 



n 



< e(s) for all < s < 1 



and 



Pr 



EJs) 



n 



>e(s) 



1 — 5n 4 



for all < s < 1 



1 as n — > oo. 



By Pr [event] we mean the probability that the event occurs where the distribution is over tt 
chosen with equal probability from the 2 n ! permutations. 

Our next result is that the minimum gap is exponentially small in n. For each tt let 

g n = min <y n (s). 

0<s<l 

where 7,r(s) is the eigenvalue gap between the two lowest energy levels of H n (s). 



Theorem 2. Let tt be a random permutation. Then 



Pr 



rf n 

9-k < n A 2 e 



1 as n — > oo. 



Our last result is that typically 7,r(s) is larger than some n independent constant for s near 1. 
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Theorem 3. Let ir be a random permutation. Then 

Pr[7^(s) > 0.8 for .9 < s < 1] — > 1 as n — >■ oo. 



A. A Lower Bound For the Ground State Energy of Stoquastic Hamiltonians 

For any normalized state \ip), and any Hamiltonian H, the quantity {ip\H\ip) is an upper bound 
on the ground state energy. It is less well known that, for some special Hamiltonians, one can also 
obtain a variational lower bound on the ground state energy of H . Theorem [4] (given below) is an 
example of such a bound. It is an elementary application of the Collatz Wielandt min-max formula 
[9], but we prove it here for completeness. We restrict to Hamiltonian matrices H where all off 
diagonal matrix elements are real and nonpositive. These are called stoquastic Hamiltonians (note 
that stoquasticity is a basis dependent notion). 

Theorem 4. Let H be a Hermitian operator, stoquastic in the \z) basis, that is {z\H\z') < for 
z ^ z' . Let Eg be its lowest eigenvalue. Then 

for any state such that {z\cp) > for all z. 

The following Lemma will be used in our proof of Theorem [4] 

Lemma 1. Let H be a Hermitian operator, stoquastic in the \z) basis, that is {z\H\z') < for 
z 7^ z' . If H\ip) = E\ip) and (z\i/j) > for all z, then E = E g , the ground state energy of H. 

Proof. Suppose E > E g . Let \ip g ) be any (normalized) state in the ground state subspace of H, so 
that H\ip g ) = Eg\ip g ). Divide the values of z into 3 sets: 

S + = {z : (z^g) > 0} 

S- = {z : (z^ g ) < 0} 

S = {z: (z\^ g ) = 0}. 

Define \ip' g ) by 
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Then ) is normalized and by the variational principle 



But 



(i>' g \HW g ) - Q> g \H\$ g ) > 0. 



(^|#|<> - (il> g \H\il> g ) =-±J2 E ^g){A^ 9 ){AH\z') 

zes + z'eS- 

< 



where in the last line we have used the stoquasticity of H. Therefore 



and so H\ip' g ) = E g \ip g ). This implies {ip\vp' g ) = 0, which is impossible since has only positive 
coefficients in the z basis and \ip' g ) has nonnegative coefficients. So we have reached a contradiction 

□ 



and therefore E = E g . 



Proof of Theorem [4] 



Let H be 



H = H-^2\z)(2 



(z\H\ 



{*\ 



Note that \4>) is an eigenvector of H with eigenvalue 0. The ground state energy of H is by 
Lemma Q] 

For any normalized state we have 

-(z\H\<t> 



\H\ 



\H\ 



(z\H\ 



(A 



> mm 



{A 



Choosing \tp) to be a ground state of H we have 



E g - (ip\H\ip) > min 



(z\H\ 

(z\<f> 



But (il>\H\ijj) > since H has ground state energy 0, so 

(z\H\, 



E g > min 

z (z\ 
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B . Proof of Theorem CD 

First for the upper bound. Recall that 



' . /on Z — / 



IT 

is the ground state of H n (0). Using this state we get an upper bound on the ground state energy 

Ti 

E 7V (s)<{x = Q\H 7r (s)\x = 0)=s-. (5) 
Recall that |tt(0)) is the ground state of H n (l). Using this state we get the upper bound 

TL 

S 7r ( S )<( 7 r(0)|F 7r ( S )| 7 r(0)) = (l- S )- 

for < s < 1. These two inequalities establish the upper bound in Theorem [T] 

Proving the lower bound is more involved. We first use Theorem [4] to show that with high 

probability the ground state energy E. K (s*) at s* just above ^ is close to the value n • e(s*). Then 

we use the concavity of E n (s) to obtain the lower bound for all s £ [0, 1]. 
We use an ansatz 1^4^} for the ground state of H n (s*) of the form 



(z\A 



1 , z ^ S n 

(6) 

An , z € S n 



where A satisfies An > 1 for n large and S n is a set of low energy bit strings, 

S 7T = {z: Wi-K^iz)) < nc] 

with c < . We can view SV as the image under tt of the set of strings with Hamming weight less 
than nc: 

S n = 7r(L) 

L = {z : W(z) < nc} . 

The following lemma bounds the probability that a group of bit strings related by single bit flips 
are all in a random set. 

Lemma 2. Let M be a set of n-bit strings such that 

\M\ < 2 n7 
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for some < 7 < 1. Let k be an integer. Let ir be a random permutation of the set of all n-bit 
strings, and consider n{M), the image of the set M . Let p be the probability that there exists an 
n-bit string z and a set of k — 1 bits {ii, 12, 1} such that {z, z © e^, z © ej fc _ 1 } C 7r(M). 
Similarly let q be the probability that there exists an n-bit string y and a set of k bits {ji,j2> ••• ) Jfc} 
such that {y © ej 1 , y © ej k } C 7r(M). T/ien 

p < n *2 n t 1 - fc t 1 -T)] 

and 

Q < n *2 n [ 1 - fc ( 1 -T)] . 

Proof. Fix a particular z and a set of k — 1 bits {21,^2, Zfc-i}- Then 

|M|-(|M|-l)...(|M|-fc + l) 



Pr [{z, z © e ix , z © e ifc _ 1 } C vr(M)] 



2** - (2" — 1) ... (2» — fc + 1) 

k 

1 1 w 1 \ 



IM 

^ 2 n 

n \ 

There are 2 n choices for z and [ I choices for the set of k — 1 bits so by a union bound 



P < 2 r 



A; - 1 y ^ 2 " 



|M|\ fc 



< n fe 2 n[l-fc(l-7)] . 

The proof for q is very similar. □ 
Lemma 3. Let s* = \ + n^i. Let n be a random permutation. Then 



Pr 



£V<**) > ( ' 2 ' S I fn-nt 



1 as n — > 00. 



Proof. Return to and set c = | — \n~±. We will show that the state |A,r) from ([6| (with A 
specified later) furnishes the claimed lower bound on the ground state energy when plugged into 
Theorem [4] In order to do this we establish some properties of the set S n . First 



n 



[cn\ 

\s,\ = £ 
3=1 \ j 



< 



1 



C c (1 - c) 
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This upper bound on \S n \ follows directly from the Chernoff-Hoeffding bound. Now let 



f(x) = -x log 2 (x) - (1 - x) log 2 (l - x) 



(7) 



so 



Now 



1 



c c (1 - c) 



l-c 



2«/(c)_ 



/(c) = /( i_i„-l ) = 1 _ 5 L 



1-2 In J + 3-4Vn/ + 5-6\n 



< 1 



1 ( 1 



21n2 \y/n) ' 

so |5^| < 2™( 1_ ^(^)). 

Lemma |5] says that the probability p that a set jz, z @ ej 1 , z © ej 2 , £ © e j fc _i } 5= "SV exists 
satisfies 



p < n 2 



OL ln2 T " 2 In 2 



We now choose 



k=\2 



n 



so that this probability goes to as n — > oo. With high probability there is no set consisting of 
more than k — 2 one bit flip neighbors of z in S n when z is in S n . So 



Pr 



(z © eil^r) . [An (k - 2) + 1 • (n - fc + 2)] 



< 



for all z £ S-k 



1 as n — > oo. 



(z\A w ) An 

Similarly the probability that a set of the form {z © e^, z © ej 2 , z © ej fc } C exists goes to zero 
as n — > oo. That is, with high probability there is no set consisting of more than k — 1 one bit flip 
neighbors of z in S n for z ^ S n . So 



Pr 



£ < An (k - 1) + 1 • (n - Jfc + 1) for all z £ 5 W 

i=i 



1 as n — )• oo. 
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Let us compute the lower bound on the ground state energy E g (s*) that is obtained by using \A n ) 
in Theorem [4] assuming both of these events occur. We get 



(z\H n (s*)\A n ) 



s*E{z) + 
1 - s* 



> < 



1 - a* 



n 



n 



1-8* 



2 (z\A n ) 
An (k - 2) + 1 • (n - A; + 2) 



An 



for z £ S-j,- 



1 - s* 
s*-nc+ I — - — I n 



Now choose 



1 - s* 



[An (k - 1) + 1 • (n - At + 1)] , for 2 



fc- 1 V 1-s 



2s*c 



so 



(2|Ar) 



> ^ 



> 



1-s* 
2 

1-s* 



n 



n + 



1-s* 
2 

1 - s* 



Xn(k- 2) + 1 • (n- A; + 2) 



An 



1 - s* 



n - (A; - 2) 



(fc-1) 



for all 2. 



for z £ S w 
for z ^ S-n- 



Recall that we picked c = \ — \n 4 and s* = \ + n 4 . This gives 



2 2' 
1 



1 

1 



1 

n4 



3[ ~ ) +4[ ~ ) +8| — I +... 



1 

n 4 



which means, since k = \ 2T,/n~\ , that A > | re 4 and 





3" 






n — ?7-4 


for all z 









(z\A n ) 

with probability approaching 1 as n — > 00. Applying Theorem [4] completes the proof of Lemma 
El □ 

We are now ready to prove the lower bound on E w (s) which is claimed in Theorem [T] Since 
H n (s) is linear in s we can write 

H w (s) = H n (s 2 ) + (»^-) H w ( Sl ) 



and taking the expectation of both sides in the ground state of H n (s) gives, for s± < s < S2, 

EAs) > ( 4—^1 em + ( ^—^-) M*h 



S2 - s\ 



S2 ~ Si 



(8) 
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by the variational principle. Since £^(0) = this gives 



Using Lemma ^ we get that with probability — > 1 as n — > oo 





3" 




n — n± 





for < s < s* 



and recalling that s 



* _ l 



+ n4 gives 



Mi) > ., u 



_ i 

n 4 



i 



+ n 4 



1 — n 4 



n / i \ 

> — I 1 — 5n"4 ) . 



Using (fsl) again twice (with s\ = 0, S2 = h an d with si = \ , S2 = 1) we get 



K(s) 



77 



>e(s) 



1 — 5n 4 



for < s < 1 with probability — > 1 as n — > oo, which completes the proof. 



C. Proof of Theorem |2] 

We will use the adiabatic theorem (in the form given in Theorem 3 of [6] with m = 1) as well 
as a theorem from [5]. For completeness we reproduce the statements of these theorems here: 

Adiabatic Theorem (from [6j ) . Let H(s) be a finite- dimensional twice differentiable Hamiltonian 
on < s < 1 with a nondegenerate ground state \(f>(s)) separated by an energy gap "f(s). Let \ip(t)) be 
the state obtained by Schrodinger time evolution with Hamiltonian H (y) starting with state |0(O)) 
at t = 0. Then 

Vi-IWTMi))| 2 <i ^ 

The next theorem considers the complexity of finding the minimum of any scrambled cost func- 
tion by continuous time Hamiltonian evolution. The quantum adiabatic algorithm is only a special 
case of continuous time Hamiltonian evolution. The theorem says that for a totally unstructured, 
i.e scrambled, cost function no quantum algorithm can achieve more than Grover speed up. 

Scrambled Theorem (modified from |5j). Let h(z) be a cost function, with h(0) = and 

h(l), h(2), h(N — 1) all positive. Let n be a permutation on N elements, and Ho{t) be an 

arbitrary n -independent Hamiltonian. Consider the Hamiltonian 

/N-l 

Hv(t) = H D (t) + c(t) ^2 h i^\z))\z){z 

\z=0 



dH 

ds 



+ 



7 (1)S 



dH 

ds 



+ 



ds 



dH 

ds 



d 2 H 

"ds* 
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where \c(t)\ < 1 for all t. Let |^ T (T)) be the state obtained by Schrodinger evolution governed 
by H n (t) for time T, with a it -independent starting state. Suppose that the success probability 
|(^ vr (T)|-7r(0))| 2 > | ; for a set of eN\ permutations. Then 

- 2 ' f N . ... 256 



T > 



64/i* 



for N > 



where 



h* 



N — 1 

We now return to the quantum adiabatic Hamiltonian H n (s) given by ([3| and apply the Adia- 
batic Theorem. We have 



7*(0) = 7.(1) = 1 



and 



dH 



ds 



< 2n. 



Here N = 2 n . Furthermore the ground state at s = 1 is \4>(1)) = | tt(0) } . The state \ifj n (T)) is 
obtained by evolving with the Hamiltonian H n (y) starting from the state \x = 0). Plugging into 
the Adiabatic Theorem we get 

-I 



(l-|(^(T)|vr(0))| 2 ) < I 



< 



< 



1 



T , 

32n 2 



An + 
4re + 



28n z 



ds 



o 7- 
28re 2 " 1 



where in the last line we used the fact that g n < 7^(0) = 1. 
Fix < e < 1. Let R be the set of permutations ir for which 



9-k > 



32n 3 



128 



Then plugging into (fol) we get 



l-|(^(T)|vr(0))| 2 < 



128n 



Now choose 



T 



128n 



for all tt £ R. 



(9) 



(10) 



(11) 



14 



which guarantees that \(ip n (T)\ir(0))\ 2 > | for all ir £ R. Assume (to get a contradiction) that the 
size of R is at least eN\. Now apply the Scrambled Theorem to obtain (for ./V > ^p) 

J2 



T > VN 

~ 64n 



where we have used the fact that in our case h* < n. But (11) contradicts the last inequality. 



Therefore R cannot contain eiV! permutations when N is sufficiently large. In other words, for 
N > 256 



Pr 



(Jtt 



< 



32n 3 



> 1 - e. 



For example choosing e = we get Theorem |2j in the stated form. 



D. Proof of Theorem 



For any Hamiltonian H, the first excited state energy E\ is equal to 



Ei = max 

\<t>) 



mm 

\f) s.t (0|V>=O 



\H\ 



where (^l^) = 1. Let us now apply this fact to bound the first excited state energy Ei )7T (s) of 
H n (s). We can get a lower bound on £i >7r (s) by fixing \<p) to be a particular state. Choosing 
\(f>) = |tt(0)> gives 



mm 

\ij>) s.t (tt(0)|V>=0 

Now the quantity on the RHS is the ground state energy of the Hamiltonian obtained from H n (s) 
by removing one row and one column corresponding to the state 1 7r(0)) . This reduced Hamiltonian 
is stoquastic and applying Theorem [4] to it gives a lower bound 

{z\H*{s)\x) 



Ei t n(s) > min , 

^tt(O) (z\ X ) 

for any state \x) such that (y\x) > for all bit strings y ^ 7r(0) and (7r(0)|x) = 0. 



(12) 



We will use the bound (12) with a state \x-k) defined by 



( z \Xw) 



1 , z S w 
fin , z G S n 
,z = vr(0). 
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where fi depending on s will be chosen later and 

S 7T = {z: ?r(0) and W(7r _1 (js)) < nc} 

for some c which we will also choose later. S n is the image of the set {z : z ^ and W(;z) < nc} 
under the permutation tt. For n large enough we will have fin > 1. 



To evaluate the RHS of ( 12 ) we need 
(z\H^(s)\x^) 



sW{n-\z)) + ( ^ I n 



l-s 



\ ( Z \Xtt) 



> < 



, 1 ~ s 

s + I — - — I n 



1 - s 



s ■ nc+ I — : — I n 



l-s\ g ^Ixtt) 

S <*l*r) 



for z £ S n 

for z ^ S n and z 7^ vr(0). 



The set S v has cardinality 



< 2 /(c)r 



where /(x) is given by (|7j). Applying Lemma [2] with k = 2 we get that with probability at least 
1 — n 2 • 2 n [ 1 ~ 2 ( 1 ~-^ c ))l there is no pair of one bit flip neighbors 

{z, z © ej} C 

and similarly with probability at least 1 — n 2 • 2 n P'~ 2 ( 1 ~-^ c "l there is no set 

{ z © e jj , © ej 2 

Choose c < s t° make /(c) = 0.49. Then with probability at least 1 — 2n 2 2 _0 ' 02n we have 



{z\H n (s)\xT 

(Ax-*) 



> < 



for Z & S-n 



s -nc+ (^) n - (^) [n// + n - 1] , for z £ 5^ , z ^ tt(0) 



(¥)--(¥) 



I _ 2s 
1— s 



, 2 



For s > 



Then 



-)„_ (1=£) ^( M+ l)_l_2^ 
~ 0.82 choose /i to be 

2sc 

A 1 = 1 1- 

1 — s 



for 2 £ 

for z ^ , z / 7r(0). 



(13) 



1 - s 



n\fi + l) - 1 



2snc 
1 - s 



1 - s 
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and 





"1 2s 




fx 1 — s 



1 -s 2 (l + 4c) 



2s (1 + 2c) - 2 

Plugging this into ( 13 ) gives that with probability at least 1 - n 2 2" 02n , for 0.9 < s < 1, 

(z\H n (s)\Xn) 



(14) 



Ei 7r(s) > min 
^tt(O) 



> 



1 



M Wl+4c) 
n + 



1 



(z\xic) ~ V 2 / 2s (1 + 2c) -2 
Then since the ground state energy of H 1T {s) is less than or equal to (^p) n, the gap is bounded 
below by the second term on the RHS, with probability at least 1 — n 2 2~°' 02n . For 0.9 < s < 1 this 
term is larger than 0.8. This completes the proof. 
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